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A  NOTE  ON  DERIVING  A  RESULT  IN  DECISION  THEORY 


INTRODUCTION 

A  number  of  textbooks  in  mathematical  statistics  [see,  e.g..  Ref.  1]  include  an  exercise  to  verify 
that  if  X  is  a  continuous  random  variable  with  finite  expectation  EiX)  and  density  function  fix),  then 
E  |  X  -  c  |  is  minimized  for  c  =  m ,  where  m  is  the  median  of  / .  This  result  is  used  in  statistical 
decision  theory  [see,  e.g..  Ref.  2], 

The  usual  way  authors  show  this  is  to  first  show  that 

E  |  X  —  c  |  =  E  \  X  -  m  \  +  2  f  (c  -  x)  fix)  dx  . 

“ffl 

Since  the  term  containing  the  integral  in  the  above  equation  is  nonnegative,  one  concludes  that 
E\X  —  m\  <  £  |  X  —  c  | ,  and  thus  E  \  X  —  c  |  is  minimized  at  c  -  m. 

MINIMIZING  THE  EXPECTED  VALUE 

The  reader  might  be  interested  in  knowing  how  one  determines  beforehand  that  the  median  is  a 
plausible  candidate  for  the  global  minimum.  The  exercise  above  asks  to  show  that  the  median  does, 
in  fact,  yield  a  minimum.  However,  one  may  not  see  readily  why  it  is  reasonable  to  choose  the 
median  in  the  first  place.  This  note  addresses  this  issue.  We  will  show  directly  that  the  median  is 
the  required  value  which  yields  the  global  minimum  for  £  |  X  -  c  | .  Our  derivation  will  also  show 
the  asymptotic  nature  of  this  expectation. 

Defining  G(c)  ■  £  |X  -  c  | ,  we  compute  G  '(c)  and  show  that  it  vanishes  at  c  =  m .  We 


Gic)  =  f  \x  —  c  |  fix)dx 
*  —  00 

=  f  (c  x)  fix)dx  +f  ix  -  c)  fix)dx 

J  —  <30  J  C 

=  c[\  ^fix)dx  -  fix)dx] 

+  f  xfix)dx  -  f  x f(x)dx  . 

"  c  »  —  oo 

Now  differentiating  G(c)  with  respect  to  c,  we  arrive  at 

G'ic)  =  f  fix)dx  -  f  f(x)dx 

J  —  OO  Jc 


=  2 Fic)  -  1 
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where  F(x)  is  the  cumulative  density  function.  Finally,  we  see  that  G'(c)  =0  if  and  only  if 
c  =  m.  Thus  we  have  found  a  possible  local  minimum  at  c  =  m. 


Now  it  is  easy  to  show  that  we  have  the  global  minimum  at  the  median.  Suppose  c  >  m. 
Then  G  '(c)  2:  0.  Further,  for  c  <  m,  we  have  G  '(c)  s  0.  Thus,  we  conclude  that  G(c)  assumes 
an  absolute  or  global  minimum  at  c  =  m . 

ASYMPTOTES  FOR  THE  EXPECTED  VALUE 

It  is  interesting  to  note  that  a sc  — •  ±  oo ,  then  G  '(c)  —  ±1.  Also,  we  note  that  for  c  —  oo. 

G(c)  ~  c  -  E(X)  , 

and  for  c  —  -  » , 

i 

t 

!  G(c)  —  — c  +  E(X)  , 

where  means  “asymptotically  equal  to”.  Equivalently,  we  can  write 

j  lim  =  i  . 

I  c  —  ±00  C 

I 

Further,  we  remark  that  G(c)  always  lies  above  the  asymptotes. 

I 
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